Papers with Spider dataset
DuoRAT: Towards Simpler Text-to-SQL Models (2021.naacl-main)
Copied to clipboard
| Challenge: | Recent text-to-SQL models can translate natural language questions to corresponding SQL queries on unseen databases. |
| Approach: | They propose a re-implementation of the RAT-SQL model that uses only relation-aware or vanilla transformers as the building blocks. |
| Outcome: | The proposed model is based on the spider dataset and shows it can be used on large databases without human intervention. |
Addressing Limitations of Encoder-Decoder Based Approach to Text-to-SQL (2022.coling-1)
Copied to clipboard
| Challenge: | Existing attempts on Text-to-SQL task show a dramatic decline in performance for new databases. |
| Approach: | They propose a hybrid system that integrates rule-based and deep learning components to improve model accuracy. |
| Outcome: | The proposed system achieves double-digit percentage improvement for non-Spider databases. |
Enhancing Text-to-SQL with Question Classification and Multi-Agent Collaboration (2025.findings-naacl)
Copied to clipboard
| Challenge: | Existing research focuses on the optimization of prompts and improvements in workflow, with few studies delving into the exploration of the questions. |
| Approach: | They propose a text-to-SQL framework based on question classification and multi-agent collaboration (QCMA-Sql) they employ multiple cross-attention mechanisms to train a schema selector to classify questions and select the most suitable database schema. |
| Outcome: | The proposed framework outperforms state-of-the-art methods on the Spider dataset and achieves 87.4% execution accuracy. |
A Tale of Two Linkings: Dynamically Gating between Schema Linking and Structural Linking for Text-to-SQL Parsing (2020.coling-main)
Copied to clipboard
| Challenge: | Existing methods for text-to-SQL semantic parsing require strict structured prediction due to its application scenario where the output SQL will be sent to an executor program directly. |
| Approach: | They propose to use schema linking and structural linking to link NL to the database schema. |
| Outcome: | The proposed method shows significant gains on the Spider dataset. |
A Pilot Study for Chinese SQL Semantic Parsing (D19-1)
Copied to clipboard
| Challenge: | Existing datasets to map natural language text into SQL are limited in their use in question-to-sql mapping. |
| Approach: | They propose to use a Chinese-based semantic parser to map natural language text into SQL. |
| Outcome: | The proposed dataset compares a character-based parser with a word embedding scheme for Chinese . the results show that the parsers are subject to segmentation errors and cross-lingual embedders are useful for text-to-SQL mapping. |
Clause-Wise and Recursive Decoding for Complex and Cross-Domain Text-to-SQL Generation (D19-1)
Copied to clipboard
| Challenge: | Existing deep learning approaches for text-to-SQL generation are limited to the WikiSQl dataset . a novel clause-wise decoding neural network model can be used to generate complex queries over multiple databases . |
| Approach: | They propose a SQL clause-wise decoding neural architecture with a schema encoder to address the Spider task. |
| Outcome: | The proposed model achieves 4.6% accuracy gain on the Spider dataset and 9.8% accuracy gain in test and dev sets. |
RAT-SQL: Relation-Aware Schema Encoding and Linking for Text-to-SQL Parsers (2020.acl-main)
Copied to clipboard
| Challenge: | Existing semantic parsing models struggle to generalize to unseen database schemas. |
| Approach: | They propose a framework to address schema encoding, schema linking, and feature representation within a text-to-SQL encoder. |
| Outcome: | The proposed framework boosts the match accuracy to 57.2% on the spider dataset, surpassing its best counterparts by 8.7%. |
SPARQLing Database Queries from Intermediate Question Decompositions (2021.emnlp-main)
Copied to clipboard
| Challenge: | Using annotated datasets is difficult as it requires query-language expertise. |
| Approach: | They propose a crowdsourcing pipeline to annotate natural language questions using intermediate question representations. |
| Outcome: | The proposed pipeline reduces the burden of annotating a large dataset with queries by using intermediate question representations. |
Semantic Decomposition of Question and SQL for Text-to-SQL Parsing (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing text-to-SQL models for complex queries are limited by the syntactic complexity of SQL. |
| Approach: | They propose a question decomposition language that decomposes SQL queries into simple and regular sub-queries. |
| Outcome: | The proposed language decomposes SQL queries into simple and regular sub-queries . it is more accessible to non-experts for complex queries, enabling interpretable output . |
Enhancing Text-to-SQL Capabilities of Large Language Models: A Study on Prompt Design Strategies (2023.findings-emnlp)
Copied to clipboard
Linyong Nan, Yilun Zhao, Weijin Zou, Narutatsu Ri, Jaesung Tae, Ellen Zhang, Arman Cohan, Dragomir Radev
| Challenge: | In-context learning (ICL) is a new approach to natural language processing tasks that rely on large language models to make predictions based on context . recent studies have shown that neural symbolic design is the preferred choice for question answering systems because of its limited working memory and unreliable long-term memory. |
| Approach: | They propose to extend in-context learning to question answering tasks that utilize structured knowledge sources and to explore various prompt design strategies for employing LLMs. |
| Outcome: | The proposed approach outperforms the state-of-the-art system by 2.5 points and the best fine-tuned system by 5.1 points on the Spider dataset. |